Active Learning for Sparse Least Squares Support Vector Machines

نویسندگان

  • Junjie Zou
  • Zhengtao Yu
  • Huanyun Zong
  • Xing Zhao
چکیده

For least squares support vector machine (LSSVM) the lack of sparse, while the standard sparse algorithm exist a problem that it need to mark all of training data. We propose an active learning algorithm based on LSSVM to solve sparse problem. This method first construct a minimum classification LSSVM, and then calculate the uncertainty of the sample, select the closest category to mark the sample surface, and finally joined the training set of labeled samples and the establishment of a new classifier, repeat the process until the model accuracy to meet Requirements. 6 provided in the UCI data sets on the experimental results show that the proposed method can effectively improve the sparsity of LSSVM, and can reduce the cost labeled samples.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Least Squares Support Vector Machines and Primal Space Estimation

In this paper a methodology for estimation in kernel-induced feature spaces is presented, making a link between the primal-dual formulation of Least Squares Support Vector Machines (LS-SVM) and classical statistical inference techniques in order to perform linear regression in primal space. This is done by computing a finite dimensional approximation of the kernel-induced feature space mapping ...

متن کامل

An Iterative Learning Algorithm Based on Least Squares Support Vector Regression Machines

Aiming at the problem of the large training data set leading to amounts of calculation a sparse approximation algorithm of least squares support vector machine are proposed. Firstly using the thought of matrix block, convert the optimization problem of a Least Squares support vector machine into low order symmetric positive definite linear systems. Furthermore, use conjugate gradient algorithm ...

متن کامل

High Dimensional Function Approximation [ Regression, Hypersurface Fitting ] by an Active Set Least Squares Learning Algorithm

1 1 Basics of Developing Regression Models from Data 3 1.1 Classic Regression Support Vector Machines Learning Setting 3 2 Active Set Method for Solving QP Based SVMs’ Learning 11 3 Active Set Least Squares (AS-LS) Regression 15 3.1 Implementation of the Active Set Least Squares Algorithm 19 3.1.1 Basics of Orthogonal Transformation 20 3.1.2 An Iterative Update of the QR Decomposition by Househ...

متن کامل

L2 Support Vector Machines Revisited - Novel Direct Learning Algorithm and Some Geometric Insights

The paper presents a novel learning algorithm for the class of L2 Support Vector Machines classifiers dubbed Direct L2 SVM. The proposed algorithm avoids solving the quadratic programming problem and yet, it produces both the same exact results as the classic quadratic programming based solution in a significantly shorter CPU time. The connections between various L2 SVM algorithms will be highl...

متن کامل

Load Forecasting Using Fixed-Size Least Squares Support Vector Machines

Based on the Nyström approximation and the primal-dual formulation of Least Squares Support Vector Machines (LS-SVM), it becomes possible to apply a nonlinear model to a large scale regression problem. This is done by using a sparse approximation of the nonlinear mapping induced by the kernel matrix, with an active selection of support vectors based on quadratic Renyi entropy criteria. The meth...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2011